A systematic review on sequence-to-sequence learning with neural network and its models

نویسندگان

چکیده

We develop a precise writing survey on sequence-to-sequence learning with neural network and its models. The primary aim of this report is to enhance the knowledge locate best way deal executing it. Three models are mostly used in applications, namely: recurrent networks (RNN), connectionist temporal classification (CTC), attention model. evidence we adopted conducting included utilizing examination inquiries or research questions determine keywords, which were search for bits peer-reviewed papers, articles, books at scholastic directories. Through introductory hunts, 790 scholarly works found, assistance choice criteria PRISMA methodology, number papers reviewed decreased 16. Every one 16 articles was categorized by their contribution each question, they broken down. At last, experienced quality appraisal where subsequent range from 83.3% 100%. proposed systematic review enabled us collect, evaluate, analyze, explore different approaches implementing pointed out most common use machine learning. followed methodology that shows potential applying these real-world applications.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Sequence to Sequence Learning in Neural Network

Neural Network Elements. Deep learning is the name we use for “stacked neural networks”; that is, networks composed of several layers. The layers are made of nodes. A node is just a place where computation happens, loosely patterned on a neuronin the human brain, which fires when it encounters sufficient stimuli. Deep Neural Networks (DNNs) are powerful models that have achieved excellent perfo...

متن کامل

Sequence to Sequence Learning with Neural Networks

Deep Neural Networks (DNNs) are powerful models that have achieved excellent performance on difficult learning tasks. Although DNNs work well whenever large labeled training sets are available, they cannot be used to map sequences to sequences. In this paper, we present a general end-to-end approach to sequence learning that makes minimal assumptions on the sequence structure. Our method uses a...

متن کامل

Sequence-to-sequence neural network models for transliteration

Transliteration is a key component of machine translation systems and software internationalization. This paper demonstrates that neural sequence-to-sequence models obtain state of the art or close to state of the art results on existing datasets. In an effort to make machine transliteration accessible, we open source a new Arabic to English transliteration dataset and our trained models.

متن کامل

Neural Machine Translation and Sequence-to-sequence Models: A Tutorial

This tutorial introduces a new and powerful set of techniques variously called “neural machine translation” or “neural sequence-to-sequence models”. These techniques have been used in a number of tasks regarding the handling of human language, and can be a powerful tool in the toolbox of anyone who wants to model sequential data of some sort. The tutorial assumes that the reader knows the basic...

متن کامل

Sequence Learning and Planning on Associative Spiking Neural Network

We have been building an auto/heteroassociative spiking neural network combined with a working memory model. In this model, a statedriven forward sequence and a goal-driven backward sequence on the associative network are respectively represented by a sequence of synchronous firing in a particular gamma subcycle during a theta oscillation. These forward and backward sequence firings are transmi...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: International Journal of Power Electronics and Drive Systems

سال: 2021

ISSN: ['2722-2578', '2722-256X']

DOI: https://doi.org/10.11591/ijece.v11i3.pp2315-2326